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1.  Introduction 


The  exponential  distribution  has  played  an  important  role  for  modeling  the  life  time 
distribution  of  a  variety  of  random  phenomena.  This  distribution  arises  in  many  areas  of 
applications,  including  reliability,  life-testing  and  survival  analysis.  An  overall  introduction 
and  more  applications  of  the  exponential  distribution  model  can  be  seen,  for  example,  in 
the  contents  of  Johnson,  Kotz  and  Balakrishnan  (1994)  and  Balakrishnan  and  Basu  (1995). 

Consider  k  independent  exponential  populations  tti,  . . . ,  tt^,  with  associated  popula¬ 
tion  means  9i^i  =  l,...,fc,  respectively.  The  9\s  are  vmknown.  Let  9q  be  a  specified 
standard.  Population  tt,-  is  said  to  be  good  if  9i  >  9o,  and  bad  otherwise.  In  many  prac¬ 
tical  situations,  an  experimenter  is  often  confronted  with  the  problem  of  comparing  the 
k  alternatives  with  the  specified  standard  9o,  and  selecting  the  more  promising  subset  of 
the  k  populations  for  further  experimentation.  The  problem  is  known  as  comparison  with 
a  control  problem.  A  review  of  subset  selection  procedures  in  this  context  is  contained  in 
Gupta  and  Panchapakesan  (1985). 

Now,  consider  a  situation  in  which  one  is  repeatedly  dealing  with  the  same  selection 
problem  independently.  In  such  instances,  it  is  reasonable  to  formtdate  the  component 
problem  in  the  sequence  as  a  Bayes  decision  problem  with  respect  to  an  unknown  prior 
distribution  on  the  parameter  space.  One  then  draws  useful  information  from  the  accu¬ 
mulated  historical  data  to  improve  the  decision  at  each  stage.  This  is  the  empirical  Bayes 
approach  due  to  Robbins  (1956,  1964).  Empirical  Bayes  procedures  have  been  derived 
for  subset  selection  goals  by  Deely  (1965).  Recently,  Gupta  and  Liang  (1988,  1994)  and 
Gupta,  Liang  and  Rau  (1994a,  1994b)  have  studied  certain  selection  problems  using  the 
empirical  Bayes  approach.  Many  such  empirical  Bayes  procedures  have  been  shown  to  be 
asymptotically  optimal  in  the  sense  that  the  Bayes  risk  for  the  (n+l)—st  decision  problem 
converges  to  the  optimal  Bayes  risk  which  would  have  been  obtained  if  the  prior  distri¬ 
butions  were  fully  known  and  the  Bayes  procedure  with  respect  to  this  prior  distribution 
were  used. 

In  this  paper,  we  axe  dealing  with  the  problem  of  selecting  good  exponential  popu¬ 
lations  compared  with  a  control  using  the  empirical  Bayes  approach.  In  Section  2,  the 
selection  problem  is  formulated  and  a  Bayes  selection  procedure  is  derived.  In  Section 
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3,  an  empirical  Bayes  selection  procedure  is  constructed  by  mimicking  the  behavior  of 
the  Bayes  selection  procedure.  The  asymptotic  optimality  of  the  empirical  Bayes  selection 
procedure  is  established  in  Section  4.  The  associated  rate  of  convergence  of  the  regret 
Bayes  risk  of  is  also  investigated.  The  analysis  shows  that  the  rate  of  convergence 
is  influenced  by  the  tail  probabilities  of  the  underlying  distributions.  It  is  shown  that 
under  certain  regularity  conditions  about  the  moments  of  the  prior  distribution,  the  em¬ 
pirical  Bayes  selection  procedure  is  asymptotically  optimal  of  order  for  some 

0  <  A  <  2.  A  lower  bound  with  rate  of  convergence  of  order  0{n~^)  is  also  established  for 
the  regret  Bayes  risk  of  the  empirical  Bayes  selection  procedure  5*.  This  result  suggests 
that  a  rate  of  order  0{n~^ )  might  be  the  best  possible  rate  of  convergence  for  the  empirical 
Bayes  selection  problem. 


2.  Formulation  of  the  Selection  Problem 

Consider  k  independent  exponential  populations  tti,  . . .  ,7rjk,  with  probability  density 
function  >  0,6i  >  0,  respectively.  The  diS,i  =  1,...,^:,  axe 

unknown.  For  a  specified  standard  Bq  >  0,  population  TTj  is  said  to  be  good  if  Bj  >  Bo,  and 
bad  otherwise.  The  selection  goal  is  to  select  all  good  populations  and  to  exclude  all  bad 
populations. 

Let  Q  =  {B  =  (^1, . . .  >  0,i  =  be  the  parameter  space  and  let 

A  =  {a  =  (oi, . . . ,  ajfc)|ai  =  0, 1;  i  =  1, . . . ,  A:}  be  the  action  space.  When  an  action  g  is 
taken,  it  means  that  population  tt,-  is  selected  as  good  if  Uj  =  1,  and  excluded  as  bad  if 
a,  =  0.  For  parameter  B  and  action  g,  the  loss  function  L{B^  g)  is  defined  as: 

k 

L{B,q)  =  ^  ^{Bi,ai)  (2.1) 

i=l 

where 

i{Bi,  ai)  =  aiBi{Bo  -  Bi)I{Bo  >  Bi)  +  (1  -  ai)Bi{Bi  -  Bo)I{Bi  >  Bo)  (2.2) 

and  I{A)  is  the  indicator  function  of  the  event  A. 

For  each  z  =  1, . . . ,  A:,  let  Xii , . . .  Xim  be  a  sample  of  size  m  arising  from  population  x; 

m 

with  probability  density  hi(x\Bi).  Let  Fj  =  ^  Xij.  Then  Yj  follows  a  gamma  distribution 

j=i 

with  probability  density  fi{y\Bi)  =  .  Note  that  Fi  is  a  sufficient  statistic 
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for  the  parameter  di.  Since  the  Bayes  and  empirical  Bayes  approaches  will  be  employed, 
it  suffices  to  deal  with  the  sufficient  statistics  11,...,^*.  It  is  assumed  that  for  each 
z  =  1, . . . ,  the  parameter  di  is  a  realization  of  a  random  parameter  0,-  with  an  unknown 
prior  distribution  on  Gi  on  9i  over  (0,  oo),  and  ©j, . . . ,  0jfc  are  mutually  independent.  It 
is  also  assumed  that  Gi,i  =  1, . . . ,  are  non-degenerate  and  satisfy  that  f  d^dGi(d)  <  oo 
to  insure  the  Bayes  risk  to  be  finite  and  this  selection  problem  to  be  meaningful.  We  let 

=  n 

i=l 

Let  Y  =  (Yi, . . .  ,Yk)  and  3^  denote  the  sample  space  of  Y.  A  selection  procedure 

S  =  {6i, ...  ,6k)  is  defined  to  be  a  measurable  mapping  from  the  sample  space  y  into 

the  product  space  [0,1]*,  so  that  for  each  yey,6(‘ii)  =  (<5i(j/), . . . ,  (5fc(j/))  and  6i{y)  is  the 

probabihty  of  selecting  population  Xj  as  good.  Let  C  be  the  class  of  all  selection  procedures. 

For  each  6eC,  let  R{G,  6)  denote  its  associated  Bayes  risk.  Then,  Ji(G)  =  inf  R(G,  6)  is  the 

SeC 

minimum  Bayes  risk  among  the  class  C.  A  selection  procedure  So  satisfying  R{G,6g)  = 
R{G)  is  called  a  Bayes  selection  procedure.  Note  that  R(G)  <  oo  imder  the  assumption 
that  J  9^dGi(9)  <  oo,i  =  1, . . .  ,k. 


Let  c(9)  =  (r(m)0'”)  ^,u{y)  =  ^  Then  fi{y\9i)  =  c{9i)u{y)e  ^1^'.  Let  f{u\9)  — 

k 

n  fi{yi\^i)-  Also,  for  each  i  =  1,. . .  ,k,y  >  0  and  nonnegative  integer  a,  define 

i=l 

poo 

i’ia{y)=  /  9^c{9)t-ylUGi{9).  (2.3) 

J9=0 

Then,  fi(y)  =  J  fi(y\9)dGi{9)  =  u{y)ipio(y)  is  the  marginal  probability  density  of  Yi.  Let 

f{y)  =  n  Myi)- 

i=l 

From  the  preceding  statistical  model  and  the  loss  function  L(9,  g),  the  Bayes  risk 
associated  with  the  selection  procedure  6  is: 

k 

R{G,6)  =  Y.^i(^^^i^  (2.4) 

i=l 


and 


Ri{G,Si)  =  /I'fi  fj{yi)h{yi)^i{u)[^o^ii{yi)  -  My 


i) 


k 


=/  n  fj{yj)]u(yi)6i(u)i?ii{yi)[9o  - ipi{yi) 


dy  -I-  Ci 


dy  4-  Ci, 


(2.5) 
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where  C,  =  9i{di  —  9o)I{9i  >  9o)dG{9)  which  is  independent  of  the  selection  procedure 
8,  and  <pi{yi)  =  • 

Let  Hiivi)  =  9oi^ii{yi)  -  V’i2(yi)  =  MyiM  -  ‘fi{yi)]-  Note  that  V'ii(yi)  >  0.  From 
(2.5),  a  Bayes  selection  procedure  6g  =  can  be  obtained  as  follows:  For 

each  yej^and  i  =  1, . . . ,  fc, 


Sciiu) 


1  if  Hi{yi)  <  0, 
0  otherwise, 


={ 


1  if  (pi{yi)  >  9o, 
0  otherwise. 


(2.6) 


Note  that  for  each  component  ijSci  depends  on  y  only  through  j/j.  Therefore  Saiy) 
can  be  written  as  Saivi)-  The  minimum  Bayes  risk  is 


Jt(G,Sa)  =  '^  Ri{G,Sai) 


(2.7) 


1=1 


and 


u(y)8Gi(y)tpii{y)[dQ  -  ^iiy)]dy  +  Ci 

u{y)8Gi{y)Hi{y)dy  +  C,-. 


(2.8) 


IS 


,  ,  ,  f  9'^c(e)e-^IUGi(9)  . 

Note  that  Vi(!/)  =  ^ j  ' 

prior  distribution  Gi  is  non-degenerate. 


continuous  and  strictly  increasing  in  y  since  the 
We  assume 


Assumption  A  lim  <^i(y)  <  <  lini  ^i{y)j  i  =  1,  •  •  • , 

y—^Q  y— +00 

Under  Assumption  A,  for  each  i  =  1, . . . ,  fc,  there  exists  a  unique  value  a,-  =  ai{9o) 
such  that  (pi{ai)  =  9o,(pi{y)  <  9o  if  y  <  ai,  (pi{y)  >  9o  if  y  >  a,-.  Hence,  the  Bayes 
selection  procedure  Sg  —  {8gi  y  •  ■  •  j  8Gk)  can  be  represented  as:  For  each  i  =  1, . . . ,  k  and 
y  >  0 


8Gi 


if  y  >  flj, 

otherwise. 


(2.9) 
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Finally,  for  each  ?  =  let  dG*{d)  =  where  mi{Gi)  =  / ddGi{9).  Then, 

G*  is  also  a  distribution  on  9i  over  (0,oo).  Define 

!t(y)  =  J  fi(yndGK«)  = ’‘(y)My)/mi(Gi).  (2.10) 

Then,  <fi{y)  =  =  EG*d^i\^i  —  vl  ■  “posterior  mean”  of  0,-  given  Yi  =  y  and  G* 

is  the  prior  distribution  of  Oj.  Hence,  i2,(G,  ^Gi)  be  represented  as: 

fiOO 

RiiG^Sci)  =  /  mi{Gi)f:{y)SGiiy)[9o  -  ^iiy)]dy  +  Ci.  (2.11) 

Jy=zO 

Note  that  the  Bayes  selection  procedure  6g  depends  on  the  prior  distribution  G.  Since 
G  is  unknown,  it  is  not  possible  to  implement  the  Bayes  selection  procedure  6g  for  the 
selection  problem  at  hand.  In  the  following,  the  empirical  Bayes  approach  is  employed. 

3.  Construction  of  An  Empirical  Bayes  Selection  Procedure 

3.1  Empirical  Bayes  Framework 

The  empirical  Bayes  framework  of  the  selection  problem  is  given  as  follows. 

For  each  i  =  1,...,A;,  at  stage  i,  let  {Yie,Qii)  denote  a  pair  of  random  vector  so 
that  Yu  is  observable,  but  0,-^  is  not  observable.  Also,  given  Qu  =  9u,Yu  follows  as 
a  gamma  distribution  with  probability  density  fi{y\9i£)  and  0,£  has  a  prior  distribution 
Gj.  It  is  assumed  that  (Yi^,  0,f),  i  =  1,...  =  1,2, ....  are  mutually  independent. 

At  the  present  stage  n  +  1,  we  let  Yi(n)  =  (Yu,. . .  ,yi„)  denote  the  historical  data  and 
Yi  =  Yi^n+i  the  present  random  observation  associated  with  population  ■Ki,i  —  1,... , fc. 
Let  Y(n)  =  (Yi(n), . . .  ,Fjk(n))  and  F  =  (Yj, . . .  ,yik).  At  the  present  stage  n  +  1,  we  con¬ 
sider  the  problem  of  selecting  all  good  from  among  (^i,n+i)  •  •  • ,  ^jfc,n+i)  compared  with  the 
standard  value  9o  using  the  loss  function  L{9n+i,q),  where  9n+i  =  (^i,n+ij •  •  •  5^fc,n-i-i)- 
At  stage  n  -f  1,  an  empirical  Bayes  selection  procedure,  say  Sn  =  (Sni,  -  ■  ■  ,9nk)^  is  a 
measurable  function  defined  on  the  sample  space  of  Y  x  Y(n),  into  the  product  space 
[0,1]*,  so  that  5n(u,Y(n))  =  {6ni(UjY{n)), . . .  ,6nk(u,Y(n))  =  (Sniiu),- ■  ■  i^nkiu))  = 
Sn(‘u)sxid6ni(y,Y(n))  =  Sni(y)  is  the  probability  of  selecting  TTj  as  good. 

Let  i?(G,^n|Y(^))  denote  the  conditional  Bayes  risk  of  the  empirical  Bayes  selection 
procedure  Sn  conditioning  on  Y(n),  and  let  R(G,6n)  denote  the  overall  Bayes  risk  of  the 
selection  procedure  Sn-  Then, 
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R{G,6n\y{n)) 


V 


=  X:  Ri{G,6ni\Y{n)) 

i=l 

=  /y[  n  fj(yj)]u{yi)Sni{u)Si{yi)du  +  Ci 

i=x 


(3.1) 


and 


'  R{G,8n)  =E  Ri{G,Sni) 

i=l 


Ri(G,6ni)  =  fy 


n  fj(yj) 


(3.2) 


where  the  expectation  EY{n)  taken  with  respect  to  the  probability  measure  generated 
by  Y{n). 

Since  6g  is  the  Bayes  selection  procedure,  Ri{G,6ni\Y(n))  —  Ri(G,6Gi)  >  0  for  all 

~k 

Y{n),n  and  each  i  =  1, . . . ,  fc.  Thus  R{G,  S„)  —  R(G,Sg)  =  J2lEi(G,Sni)  —  Ri(G,SGi)]  >  0 

i=l 

for  all  n.  This  nonnegative  regret  Bayes  risk  D(G,  Sn)  =  R(G,  6n)  —  R{G,  6g)  is  used  as  a 
measure  of  performance  of  the  empirical  Bayes  selection  procedure  Sn- 


Definition  3.1.  A  sequence  of  empirical  Bayes  selection  procedures  {^n}^i  is  said  to 
be  asymptotically  optimal  relative  to  the  prior  distribution  G  if  R{G,6n)  —  R{GiSg)  = 
o(l).  is  said  to  be  asymptotically  optimal  of  order  {on}^!  relative  to  the  prior 

distribution  G  if  R(G,6n)  -  R(G,Sg)  =  0(a„)  where  is  a  sequence  of  positive 

numbers  such  that  lim  On  =  0. 

n-^oo 

3.2.  The  Proposed  Empirical  Bayes  Selection  Procedure 


We  construct  an  empirical  Bayes  selection  procedure  by  mimicking  the  behavior  of 
the  Bayes  selection  procedure  Sq  of  (2.6). 

Note  that  the  functions  V’iaCy),  a  =  1,  2,  can  be  written  as: 

f  V’ii(y)  =/<=„ 

<  (3.3) 

[  V’i2(y)  =  ti}io{t)dt  -  y^i\{y). 

For  each  i  =  1, . . . ,  A:,  £  =  1, 2, . . . ,  and  y  >  0,  define 
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Vu{y)  =  I{Yii  >  y)lu{Yu). 


(3.4) 


Then,  Ey u{y)]  =  -  y)Vu{y)\  =  ■0i2(y) -Thus,  for  Wii{y)  =  (^o  + 

y  -  Yie)Vie{y),  Ey^^^lWuiy)]  =  ^oV’ii(y)  -  V’i2(y)  =  Hi{y).  Now,  for  each  z  =  1, . . . ,  fc,  and 
y  >  0,  define 

^  E  (3-5) 

t=i 

Hin{y)  is  an  unbiased  and  consistent  estimator  of  Hi{y).  By  mimicking  the  form  (2.6),  we 
propose  an  empirical  Bayes  selection  procedure  =  (^nii •  •  •  ^ ^nJk)  follows:  For  each 
i  =  1, . . . ,  A;,  and  y,-  >  0, 

Cfe)={' 

0  otherwise. 

The  Bayes  risk  of  the  empirical  Bayes  selection  procedure  5*  is: 

k 

•r(g.«)  =  E 

i=l 

/•oo 

RiiG,Ki)=  <y)EY,JKi(v)]Hi(y)dy  +  C,  (3-7) 

Jy=0 

=  /  ^^(y)^y(„)Ki(y)]V’ii(y)[^o  -  My)]dy  +  Ci. 

Jyz=.Q 

4.  Asymptotic  Optimality  and  Rate  of  Convergence 


4.1.  Asymptotic  Optimality  of 

From  (2.8)  and  (3.7),  the  regret  Bayes  risk  of  the  selection  procedure  is: 

k 

R(G,  SI)  -  R(G,  Sa)  =  Yi^Ri(G, «;.)  -  Ri{G,  «o,)l  (4.1) 

i=l 

and  from  (2.9),  for  each  i  =  1, . . .  ,k. 

Ri{G,Sli)-R,{G,Sai) 

uiy)^ii{y)[9Q  -  ^iiy)]EYf^^^[6li{y)  -  SGi{y)]dy 

=  [  u{y)xl;ii  {y)[9o  -  <pi{y)]P{6*i{y)  =  1,  Soiiy)  =  0}dy 

Jy=0 


(4.2) 


Note  that  under  the  assumption  that  f  9^dGi{0)  <  oo,  we  have 


< 


uiy)‘tpii{y)\Oo  -(pi{y)\dy 

Oou{y)^|Jil{y)dy  +  f  u{y)^ix{y)i^i{y)dy 

Jo 


=$0  J  edGi(e)  +  J  9^  dGi{e)  <  oo. 


Therefore,  to  establish  the  asymptotic  optimality  of  the  selection  procedure  it  suffices 
to  show  that  for  each  i  =  1, . . . ,  fc,  P{^*,(?/)  =  l,6ci{y)  =  0}  — 0  as  n  ^  oo  for  each 
0  <y  <  ai,  and  P{S*-{y)  =  0,  Soiiy)  =  1}  ->  0  as  n  ->  oo  for  each  y  >  ai. 

In  either  case,  for  e  =  0, 1,  by  (2.6),  (3.6)  and  the  definition  of  Hin{y), 


P{Ki(y)  =  ^Jai(.y)  =  l-€} 


<PmM  -  •ffi(v)l  > 


^EY^,-,\HUy)  -  SiivW  1 


V^(Wu{v)), 


which  tends  to  0  as  n  — >  oo  if  Yax{Wii{y))  is  finite. 

Note  that  Wie(y)  =  {9o  +  y  -  Yii)I{Yii  >  y)IY^~^.  If  m  >  2,Wii{y)  is  a  bounded 
random  variable,  and  therefore,  Var(Wi£(t/))  <  oo.  If  m  =  \,Vii{y)  =  liYu  >  y)  and 
Var(Wif(t/))  <  2(^0  +  yfY^x{Vu{y))  +  2Yox{YiiVu{y))  <  oo  since  Var(Fi<(j/))  <  1  and 
WBx{YuVu{y))  <  E[Y^^  =  E  =  £^[20?]  <  oo. 

We  summarize  the  result  of  the  preceding  discussion  as  a  theorem  as  follows: 

Theorem  4.1  Let  5*  be  the  empirical  Bayes  selection  procedure  constructed  in  Section 
3.  Suppose  that  f  9^dGi(9)  <  oo  for  each  i  =  Then,  S*  is  asymptotically  optimal 

in  the  sense  that  R{G,6'^)  —  R{G,6g)  —  o(l)- 

4.2.  Rate  of  Convergence 

In  this  subsection,  we  investigate  the  rate  of  convergence  of  the  empirical  Bayes  se¬ 
lection  procedure  by  establishing  an  upper  bound  on  the  regret  Bayes  risk  i2j(G,  ^*j)  — 
Ri(G,6Gi)  for  each  i  =  1, ...  ,k.  In  the  following,  we  consider  the  case  where  m  >  2. 
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Therefore,  Wii{y)  is  a  bounded  random  variable,  with 

Var(Wi,(y))  <  E[Wii{y)]'^ 


1 

<  -7-7  /  (t-y -do 

u{y)  Jy 


<  +  sV’isCy)]. 


From  (4.2)  and  by  the  definitions  of  and  5g, 

Ri{G,8li)-Ri{G,8Gi) 

=  f  u(y)V’ii(y)[^o  -  9?.(y)]P{ff,n(y)  -  Hi{y)  <  -Hi{y)}dy 
Jo 

+  /  u{y)tl;ii{y)[9o  -  (pi(y)]P{Hiniy)  -  Hi{y)  <  -Hi{y)}dy 

Jail2 

+  /  «(y)V’ii(y)[<^i(y)  -  dQ\P{Hin{y)  -  Hi{y)  >  -Hi{y)]dy 


yoo 

+  /  «(y)^ii(y)[<^i(y)  -  0Q]P{Hin{y)  -  Hi{y)  >  -Hi 

J  a;  +  l 


iy)}^y 


Dii  +  Di2  +  Diz  +  Di4(say). 


Note  that  for  each  ye[^,a,],0  <  Hi(y)  =  ^oV’ii(y)  “  V’i2(y)  <  ^o^ii(y)  <  doi^iii^) 
since  i’niy)  is  decreasing  in  y  for  y  >  0,  and  Wie{y),i  =  l,2...,n,  axe  iid,  bounded 
random  variables  with 

(«o  +  »  -  YidI(Yu  >y)  ^  6„I(Yu  >  y)  ,  {Y,,  -  y)I{Y,  >  y) 

Wu(yn  =  - - 

‘i£  ^  i£  ^  i£ 

<-A_  +  — 1 — , 

-  (^)”-»  (f 

So,  there  exists  a  number,  say  Qi{9o)  >  0,  such  that  IWi^(y)  —  Hi{y)\  <  — for 
all  y  e[ai/2,  a,].  Hence,  by  Hoeffding’s  inequality  and  the  definition  of  Hin(y),  for  each 
y  e[ai/2,a,], 

P{Hi„(y)  -  Hi(y)  <  -Hi(y)}  <  exp  | 


=  exp 


QliOo)  J 

■2nipl(y)[do  -<pi(y)]^ 
QK^o) 


<  exp{-nbi[do  -  <pi(y)]'^}, 
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where  6,-  =  2V’,i(f-)/(5f(^o). 

Let  Cj  =  u(a,)^ii(^).  Then  0  <  u(y)ipii{y)  <  «(ai)V’ii(^)  =  Cj  for  all  yg[^,ai]. 
Next  for  each  ye[^,ai],  since  Gi  is  non- degenerate. 


dy 


A2{y) 

dy  V’ii(y) 


Jd‘^c{d)e-y/UGi{9)  ■Jc{e)e-y/^dGi{e)  -  [Jec{d)e-y/UGi{d)f 

Jdc{e)e-y/^dGi{9) 


^i2{y)^io{y)  -  [^iijy)? 

[My)? 


>  di{ai)  >  0. 


Therefore,  combining  the  preceding  inequalities  and  replacing  them  into  Di2, 
we  obtain 


pa{ 

Di2  <  /  Ci[9o  -  (fi(y)]exp{-nbi[9o  -  ^i(y)?}dy 
Jaif2 

=  r  -  yitg)-).'!  exp{-n6,[»o  - 

Jai/2  -2nbi{9o  -  ^i{y))^ 

<  r  ~  exp(-n6.[^o  -  yi(!;F)<iy. 

Jai/2  2nbidi{ai) 


2nbidi(ai) 
Cj 

2nbidi{ai) 

=  0(n"^), 


exp(-n6i[^o  -  <^i{y)?) 


y=-r 


< 


where  (^o  -  M))'  =  -  <<?i(y)]- 

Following  an  analogous  argument,  we  obtain 


(4.6) 


Di3  =0(n-') 


(4.7) 
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Next,  for  0  <  y  <  a,/2,  by  Markov’s  inequality, 

P{H,4y)  -  H,(v)  <  -Hi(y)] 

_Var(Wii(y)) 

n\Hi{y)\'^ 


.^oV’.i(y)  +  2fe(y) 
n|ifi(y)|2u(y) 


where  the  last  inequality  follows  from  (4.3). 


Also,  for  ye(0,  ^],^o  —  V’iiv)  ^  —  ^i{^)  >  0-  Therefore, 


fail 

hi  <  / 

JQ 


n[^o  -  v?i(y)]V’ji(y) 


[^o’/’ii(y)  +  2V’i3(y)]<^y 


(fi,  fan 

.  ■°r;-u^y+  / 


_ l _ 

*i(y)  *'■ 


Here,  we  note  that  since  m  >  2, 


0  <  V’i3(y)  =  J  e^c{e)e-y/UGi(e) 

,1  ^oo 

=  /  e^c{d)e-ylUGi{e)  +  / 

/•l  yoo  a2 

<  /  ec{6)e-ylUGi{d)  +  / 

70  7i  ^ 


and  is  increasing  in  y  for  y  >  0.  Hence,  °°  every  c  >  0.  Combining 

these  results  into  (4.8),  we  obtain: 

Dn  =0(r!-‘).  (4.9) 


For  y  >  Oj  +  1,  by  Markov’s  inequality,  for  0  <  A  <  2, 

P{HUy)  -  Mv)  >  -SiW)  < 
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Therefore, 


1*00 

Du<  / 

Jai  +  l 

1*00 
<  / 

-  Si{yW'‘<iy 

(4.10) 

•/at+1 

1*00 

J  a, -hi 

So  far,  the  rates  of  order  0{n~^)  regarding  the  three  terms  Z),i,Di2  andZ)i3  are  obtained 
only  based  on  the  conditions  that  f  9^dGi{9)  <  oo  and  Assumption  A  holds.  Therefore  D,'4 
is  an  essential  part  for  the  rate  of  convergence  of  Ri{G,6*i)  —  Ri(G,6ai)‘  We  summarize 
the  preceding  result  as  a  theorem  as  follows. 


Theorem  4.2.  Suppose  that  Assumption  A  holds,  f  9^dGi(9)  <  oo  for  each  i  = 
l,2,...,fcand  u(y)lEi(y)l^~^Vax^''^(Wii(y))dy  <  oo,i  =  Then,  Ri(G,S*i)- 

Ri(G,SGi)  =  for  each  i  =  and  the  empirical  Bayes  selection  proce¬ 

dure  S*  is  asymptotically  optimal  of  order  0{n~^l^)  for  some  0  <  A  <  2.  That  is, 
R{G,8X)  -  R{G,8g)  =  0(n-V2). 

To  see  how  the  asymptotic  behavior  of  Du  is  influenced  by  the  tail  probability  of  the 
probability  density  /i(y),  we  introduce  the  following  lemma. 


Lemma  4.1  Let  Af  be  a  nonnegative  random  variable  with  probability  density  function 
h{x).  Then  for  0  <  t  <  1  and  p  >  h*(x)dx  <  (pt  — 
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Proof:  Note  that  q(x)  =  {pt  -  l)x  is  a  probability  density  on  (1,  oo).  Now, 
1*00  1  1*00 

/  h\x)dx  =— ^  /  {pt  -  l)x-P*[xP/i(x)]Vx 

Ji  -  1  Ji 

= — - — Eq[X^h{X)Y  where  Eq  is  taken  wrt  q{x) 

pt  —  1 


< — ^—{Eq[X^h{X)]y  by  Holder  inequality 
pt  —  1 


pt 


ui: 


{pt  —  l)x  ^*x^h{x)dx 


/OO 

x^(^~‘)/i(x)dx)^ 
<{pt  -  iy-\Eh[x^^^-%\ 


□ 


For  y  >  ai  +  l,<^i(y)  -  >  ‘Pi{ai  +  1)  -  do  =  Si  >  0.  Also,  note  that  u(y)V’ii(y)  = 

mi{Gi)f*{y)  where  f*{y)  is  a  probability  density  defined  in  (2.10).  Hence,  by  (4.3), 


1*00 


Jai+i  wm-dor  ^  u^'\y) 

Jai+l  Cj 

A-r'  /  Hy)My)y~^^^<^y 
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(4,11) 


/*oo 

Jai+\ 


2‘^(mi(Gi)) 


r*l  — A/2  /  \  r ^iziy') 


/  /r""'^(y)  ^  rfy- 

^a<  +  l  lV’il(y)J 


By  Lemma  4.1, 


/•OO  /•OO 

/  f:'~^'^(y)dy  <  /  f:'''^'\y)dv 

Ja{-\-l  Jl 

<(p(l  -  A/2)  -  1)-'/"  (^;/;K''*'"l)'-"'^ 


(4.12) 


for  p  >  =  2:^,  and  where 


.pA/2.  _£J(G,,/,)[eirr1 

‘  mi(Gi) 

mi(Gi) 

_r(m  +  pA/2)  [0,  A/2+1 1 

r(m)m,(Gi)  •  ' 


Therefore, 


(4.13) 


ruu 

/  f:'''^'\y)dy. 

Jai+1 

<(p(l  -  A/2)  -  1)-V2  X  lh£±^]-V2  (£0,(0^ /2+')]-a/2. 


Also,  by  Holder  inequality,  for  s  >  1  such  that  As  <  2  and  j  x  >  1, 


r  fr^%)\t^rdy 

Jai+1  [My)\ 


=Ei;  C^I\Y)I(Y  >  aj  +  1) 


i’iiiX). 


<lE,;lmY)I(Y  >ai  +  l)]-l*/2]>/. 


*  '“H  * 


(4.14) 


(4.15) 
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where 


E/;lfr(Y)I(Y  >  ai  +  1  )]-*•/". 


-L 


/, 


*l-As/2 


{y)dy 


T(m  +  ^>A5/2) 

[  V{m)mi{Gi)  . 


/a, “hi 

<(p(l  -  Ai/2)  - 
for  p  > 

Is®  =  -Sc:  l®i  =  p]  and  i  X  *  >  1 


(4.16) 


•1  1— A5/2 


X  [EG,{e 


A/2-hl  ^  j  1 — A3/2 


Ef- 


My) 

.My)\ 


A.  ^  ■ 
2  a-l 


ps  A 


=£^.[EG:[6f|yi|)^ 

SE/fBcriepiy] 

=®G;[0i‘"‘) 


=EG,(er‘'"‘l/'n,(G,). 

,^fr+ii 


(4.17) 


£^-A_li  — {-1 

For  the  two  moments  E’gJQj  ^  ]  and  EgJ©/"^  ]  with  parameters  p,s  and  A  such 

that  1  <  A  <  2,  s  >  1,  As  <  2,  2(s-i)  -  ^  P  >  lil  ~  2^’ 

let  which  implies  that  p  =  Also,  p  =  >  2-X3  1  <  •s  < 

We  summarize  the  results  of  the  preceding  discussion  as  a  Corollary  of  Theorem  4.2 
as  follows. 


Corollary  4.1.  Suppose  that  Assumption  A  holds  and  for  each  *  =  J  9’-^'^^dGi{9)  < 

00  for  some  1  <  A  <  2,s  >  1,  such  that  As  <  2,  ^  ^  a|t*  Then, 

(a)  u{y)\Hi(y)\^~^  Var  ^^'^{Wii(y))dy  <  00  for  each  i  =  1, . . . ,  A;. 

(b)  The  empirical  Bayes  selection  procedure  is  asymptoticeilly  optimal  of  order 


5.  A  Lower  Bound  for  R(G,  ^*)  —  R(G,  ^g)  and  the  Best  Possible  Rate  of  Con¬ 
vergence 

In  this  section,  we  will  establish  a  lower  bound  with  its  rate  of  convergence  for  the 
regret  Bayes  risk  R{G,6*)  —  R{G,6g)-  In  fact,  it  suffices  to  consider  a  lower  bound,  say, 
for  RiiG,S*i)  -  RiiG.Soi)  since  R{G,Sl)  -  R(G,5g)  >  Ri{G,S*i)  -  RiiG^Sa). 
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Theorem  5.1.  Let  Assumption  A  hold.  Then, 


Ri(G,6*^,)-Ri{G,6Gi)>0{n-^). 


Proof:  From  (4.4) 

R,iG,6*,i)-RiiG,6Gi) 


> 


r  u{y)<Pn{y)l«,  -  iPi{y)]P{Hi,(y)  -  Hi(y)  <  -Hi{y)}dy. 


(5.1) 


It  follows  from  Lemma  3,  on  page  47,  of  Lamperti  (1966)  that  for  all  ^  >  0,  and  for  n 
being  sufficiently  large, 

P{Hiniy)  -  Hi{y)  <  -Hiiy)} 

^pj  Vn{Hin{y)  -  Hi{y))  ^  -^Hi{y) 


\  VVar(Wia(y))  “  V  Var  {Wi 


U{y)  1 

Vix{y))l 


>exp^ 

-  2  Var  (Wii(y))  j 


=  exp 


>  exp  <  — 


^V^?i(y)(i  +  0(^0  -  yi(i/))^ 

2  Var  (IVii(y)) 

»V’?i(¥)(i  +  0(^0  -  ’Pii.y)? 

7i 


(5.2) 


=  exp{-nrii(^o  -<^i(y))^}, 

where  7i  =  2  min  Var(Wii(y))  >  0  Since  Gi  is  non-degenerate  under  Assumption  A  and 

[^,ai]  is  a  compact  interval,  and  th  =  V’^i(^)(l  +  0/7*  >  ''’»2  =  • 

Then  r,-2  >  0.  Therefore,  from  (5.1)  and  (5.2), 

Ri{G,8l,)-Ri{G,8Gi) 

Aa,- 

>  /  ti(y)V’.-i(y)[^o  -  ^i{y)]  exp{-nra(^o  -  '•pi{y)f]dy 

Jail2 

u(y)4,>^(y)2nn,{9o  -  Vi(yWM  exp{-nT..(^,  -  ^fy)r}dy 

Jai/2  2nrii9?'.(y) 
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rdi 

~  Jai/I 


ri2 

j2  2,nTii 


2nTii(9o  -  <fi{y))<p'i{y)exp{-nTii{do  -(pi(y)f}dy 


Ti2 


2nTii 

Ti2 


exp{-nr,i(^o 


o; 


2nTii 

=0(n-i). 


y=ail2 

(1  -  exp{-nTji(So  - 


(5.3) 


Therefore,  the  proof  is  complete. 


□ 


Theorem  5.1  provides  a  lower  bound  with  a  rate  of  convergence  of  order  0(n“^)  for 
the  regret  Bayes  risk  R{G,  ^* )  —  R{G,  So),  while  Corollary  4.1  gives  an  upper  bound  with 
a  rate  of  convergence  of  order  for  the  regret  Bayes  risk.  When  A  is  close  to  2,  a 

rate  of  convergence  of  order  0(n~^)  will  be  the  best  possible  rate  of  convergence  for  the 
empirical  Bayes  selection  procedure  S*.  Suppose  that  the  unknown  prior  distribution  G  is 
such  that  Gi{9*)  =  1  for  some  0  <  ^*  <  oo,i  =  1, . . . ,  A:,  and  Assmnption  A  holds.  Then 
Eoi  [0*]  <  oo  for  all  <  >  0.  Thus,  the  quantity  A  in  Corollary  4.1  can  be  chosen  to  be  very 
close  to  2.  For  example,  if  we  let  A  =  An  =  2  —  2  in  in  in  n/in  n  for  n  >  16,  then  the 
rate  of  convergence  is  of  order  0(n~^  in  in  n),  which  is  close  to  0(n“^). 


6.  Concluding  Remarks 


We  have  presented  a  method  to  construct  an  empirical  Bayes  procedures  for  selecting 
good  exponential  populations  compared  with  a  control.  Through  the  analysis  developed 
in  Section  4,  we  can  see  that  the  part  Da  plays  an  essential  role  in  determining  the  rate 
of  convergence  of  the  selection  procedure  We  have  demonstrated  that  the  rate  of 
convergence  of  is  influenced  by  the  tail  probability  of  the  marginal  probability  densities 
fi(y),i  =  or  the  moments  of  the  prior  distribution  G.  This  empirical  Bayes 

selection  procedure  is  asymptotically  optimal  and  achieves  a  rate  of  convergence  with 
order  <  A  <  2,  which  may  be  close  to  the  best  possible  rate  of  order  0(n“^) 

under  some  regularity  conditions  about  the  moments  of  G  according  to  Corollary  4.1.  When 
the  random  parameters  are  bounded  and  Assumption  A  holds,  we  have  exhibited  that 
may  achieve  a  rate  of  order  0(n~^  in  in  n),  which  is  close  to  However, 

it  is  not  known  whether  achieves  the  rate  of  order  0{n~^)  or  not.  Singh  (1979)  and 
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Singh  and  Wei  (1992)  have  commented  that  “a  rate  of  the  order  0{n~^)  has  not  been 
achieved  for  any  empirical  Bayes  procedures,  whatever  may  be  the  component  problem,  in 
any  Lebesgue-exponential,  non-exponential  regular  or  irregular  family”. 
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